Facial Recognition in Tennis

Stephanie Kobakian

18 July 2016

Project Aim

Begin to develop methods to collect accurate information about the facial expressions of elite tennis athletes during matchplay.

This beginning involves testing how well currently available facial recognition software performs at identifying faces of the two players in a tennis match.

Current Recognition Software

Current software has been intended for security purposes including:

This presents issues as our use on Tennis Broadcasts provides multiple interchanging angles. This is unlike the intended use of a full frontal scan at an access point.

Challenges

Opportunity

Our Sample

105 Singles Matches from 2016 AO differing by:

We then took:

Computation Times for recognition of stills

Examples of Application

The following slides include stills and what was recognised when the softwares were applied.

Accuracte Facial Recognition

The software that is chosen should be able to rcognise this face even though it is not a front on angle

Accuracte Facial Recognition

The software that is chosen should also be able to rcognise this face

Accuracte Facial Recognition

We would hope that this angle would still allow for recognition, however it was only recognised by one software,

Accuracte Facial Recognition

We would hope that this angle would still allow for recognition, however it was only recognised by one software

Accuracte Facial Recognition

We would hope that this size would still allow for recognition, however it was only recognised by one software, note that the minimum pixel distance that will allow for recognition is 36

Emotion Facial Recognition

As this is the intended future use we would need the software to detect emotions and angles such as this

Emotion Facial Recognition

This angle should also be detected by any software we would consider for this use

Emotion Facial Recognition

This angle should also be detected by any software we would consider for this use

Inaccuracte Facial Recognition

Inaccuracte Facial Recognition

Inaccuracte Facial Recognition

Interesting Recognition

Skybiometry was able to identify this ‘face’, created by the creases in the shirt

Interesting Recognition

Animetrics was able to identify two faces in this image, one being a towel

Interesting Recognition

Interesting Recognition

Crowd Recognition

Crowd Recognition

Crowd Recognition

Impractical Shots

Some shots result in difficulties when applying recognition software

Upward Angle

Birdseye View

Upward Angle

Birds-eye View

Obstructed Faces

Manual Recognition

Our Gold Standard to compare to the softwares selected

Still to come…

Comparisons of:

Questions and Recommendations